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ABSTRACT 

Project Esperanza supplemented the basic special 
educatibn program for handicapped students With limited English _ 
proficiency (LEP) by prbviding (1) staff training and consultation, 
(2) materials develbpment, identification, and evaluation, t3)_^_ 
assistance in *he diagnosis bf educational needs and the prescription 
of instructional strategies, (4) direct iadi^id"Sl»"J»on of _ _ 
instruction, and (5) outreach services. During 198|-83, the project's 
third and final year, 515 students were served in 28 elementary, 
intermediate and secondary schools in Hew York City. project staff 
included a prbject Cbordinator, two resource specialists, a^ 
curriculum specialist, two educational assistants, and two family 
assistants. Analysis bf data from pupil achievement measures, program 
records, and interviews and bbservations lead to the ^overall 
conclusion that Project Esperanza provided an effective, ^ _ 
comprehensive program bf supplementary services that promoted the 
academic development of handicapped LEP Si.adentB. Ail program ^ 
objectives for pupil achievement were attained: proposed criteria 
were met in EnoliSh and Spanish reading, bral-English proficiency, 
mathematics, and cultural heritage^ the prbject V*'^;"^^' 
training was also attained. After participating in teacher workshops, 

cJassrbbm teachers deifibn it rated proficiency in developing _ _ 

culturally-relevant individualized lessons for bilingual special 
education students. The objective for parent involvement was not 
attained, despite efforts by prbjeCt staff and improvement over 

pravibus cycles. Relative to many other projects for similar 

Ibpulationl, however, a moderate degree bf parent participation was 
achieved. (Author) 




ERIC 



E.S.E^ft. TITIE VII 



PomFri PSPERANZA Sivisibrt of Special Education 

PROJECT ESPEKfiN£A sert^ier, Chief AeJml^iistrator 

jgg2_33 O.S.E. Re1s5ursa61e Programs 

All f son Tupper 

tydia Cortes* Project Coordinator 



Prepared 6y: 

d.E.E. /Special Education Evaluation Unit 

Robert Tobias. Evaluation Baiiager 
derdme l^rio^ls, Evaluation Specialist 
Christine Halfarj Evaluation Associate 
Marcia TerreSi Consultant 
Frances Francois ^ Consultant 



New York City Public Schools 
Bffice of Educational Evaluatidri 
Richard SUttenberg, Pi rector 



A SUMMARY OF THE REPORT 



Prelect Esperanza su^plenented tHe.basic. specifL.e^^^^tJ^S prograS 
Pro^iding jl) staff training and cons, t ti^ 

rierit, Identification, and evaluation, (3} f^^^'J^^^^J 't^^fpliPs and 
educational needs and the prescrtption f 

(4)direct individualization of instruction, and {5) outreach services. 

During 1982-83. t^e P--°3ect's third and final 5^ar^^515 St 
served in 28 elOTentary. i"tef«diate. and secondanr schpo s. Pro.i^^^^ 
Itifl included a project coordTrtator. two resource specie sts. a earn- 
cufJ^ Tp^iialisl'two edacational assistants, and two f««ily assistants. 

The analyses of data from pupil achievOTint s^asures, prof r^ records » 
L.E.P. students. 

All of the progr^ objectives for P«P'' J^^^f ^^"^ *''^4rij"??lh^ 
prop^lk criteria were met in Eiglish^^Jd Spanish reading. oral-English 
proficiency i mathematics, and cultural heritage. 

ThA oroiect obiective for teacher trai hi ng was also attained. ^After 

biUnqual special education students. 

The obiective for parent involvernent was not attained, despite efforts 
The objectwe P^^^. however, ah improvement over previous 

gcfe f ndf rllatiJ^^^Jd S^^ otftlr^projectvfor similar populations, a 

moderate degree of parent participation was achieved. 
The following are reco^^ndatiohs for improving 

materials and assessment instruments; and continue efforts to invoiv 
parents. 
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i. ifNTRooueriBN 

This report presents the findings of the evaluation of the third and 
final year of Project Esperanza, funded under EiS.E.A. Title VII. This 
progran provided supplemental instruction* staff training, resource 
assistaficei and out-reach services to support the special education 
program for handicapped Spanish-speakifig pupitis srith limited English 
proficiency (tiEiPi)i 

Project Esperanza was designed to artist the nivisioh of Special 
Education (O.S.E.) of the New York City Public Schools in effectively 
meeting the educational needs of special education L.E.P. students who had 
not previously been served in a Title VII bilingual special education 
program. Popu1i\tion projections l«sed on a census by b.S.f, estimated 
that by 1983* the number of handicapped t.EiP^ students in the New York 
City Public Schools would increase to approximately 10 tfidbsah^i To 
provide- appropriate educational services for this population, D.S.E. 
marshalled efforts to identify these students and IhCfease the number of 
self-contained, b11in§aa? special educatl^^j classes. Project Esperanza's 
mission ^s to provf:ae compr^h^^slye stippT esentsrj services to assore the 
quality of the expanding bilingual special e&cation program* 

In 1980-81, tts first year of operation. Project Esperanza served 
approximately 300 students whose bfisit educational program was provided in 
25 bllihgual special education classes in 20 schools. All of the prograffi 
objectives for pupil achievement were attained; the proposed criteria were 
met in English and Spanish reading. oral-English proficiency, mathemaMcs. 
and cultural heritage. The high school -level population demonstrated 
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larger gains titan the eler-ehtlry. of faiddle-^chbbl tt^s in Spanish 
readings natrienatics, and cultural heritage; hose^er, the high s^chbdl 
students also sho«ed a higher rate of truancy. TKe elenentary-school 
students showed significantly larger gains in oral-English proficiency 
than the siddlt- or high-school studehtSi 

The project objective fcr teacher training Was also attained. After 
participating in teacher workshops, classroorn teachers danbnstrated 
proficiency in developing individual instructidnil objectives as the fociis 
of a diagnostic-prescriptive teaching approach. Respite repeated and 
varied efforts by project staff, the objective for parent irvolvetr^nt was 
not attained. 

During 1981-B2. the second year Of^he project. 458 students «pe 
served, an increase of 3« percent. Students attended 44 bilingual special 
education classes in 28 scfeols. All of the program objectives for pupil 
achievement ..ere attained, as they had been during the first year of the 
project. Thf proposed criteria mre mt in oral.Ef»gl1sh proficiency, 
mathen^tics. and caltural heritage. Reversing the pattern observed during 
the first year, the elementary sehdel population made the greatest pins 
in Spanish reading. iflath««at1cs. and caltural heritage, and high school 
students made the greatest gains in orat-English proficiericy. 

teachtr-tralning s^^ectives were #^so nui^Mi teacfiers c^^inued to 
,m proficiency in developing Individual instr^ioMl .^jeetive? in the 
implenentatidn of a diagnostic-prescriptive appr#ch. As in the previous 
year, only moderate success was seen In att^pts to increase parental 
involvement, despite th^ additionil efforts of the National Origin 
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Desegregatibn Assistance Center. 

project Esperanza for 1982-83 «s evaluated by the Office of Educational 
Evaluation (O.E.E.) through the collection and analysis of data fro. pupil 
achievement tests, program, records of parent participation and staff 
training, and interviews and observations coheerhVng the level and quality 
of progr^ impl^entatio.. These data -ere analyzed in order to address 
the following evaluation questions: 

i HOW successful ly did the program meet its ^^J^^^J^tu^^^^ 
achievoaent and staff and parent training objectives? 

V Whn »«re the bilingual tax-levy staff's perceptions of the 
pr6gr»»'s resource services? 
The following chapters present the findings of the evaluation. 
Cfi^pter II provides a description of the program and the evaluation of 
progrSn implementation; Chapter III aldresses the level of attainment of 
program objectives; and Chapter IV presents conclusion, and recommendations. 
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II. EVALUAtldN OF PReSRAH IMPLEHEfltAiON 



DESCRtPTIOH 

Project Esperahla suppl anented the basic special education progr^ for 
*ca.dic.pp.d L.E.P. students by providing (1) staff training and consultation, 
(2) mterials development, identification, and evaluation. (3) assistance 
i.'tne diagnosis of educational needs and the prescription of ihstructipnal 
strategies. (4) direct individualization of instruction, and (5) outreach 



services. 
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in the project's third and final year of operation, the basic educational 
progran was .gain provided In self-contained classes staffed by tax-levy 
teachers in the ratio of one teacher to 12 students. The target population 
had never been served by other D.S.E. title VH or Chapter 720 programs. 
Participating students «re either recently identified as handicappea 
t.E.P. students or drawn from a t^aitin^ list. Proar^ referrals were made 
,y school-based support teams. Committees o. tHe Handicapped, special 
class and Grisis-intervention teachers, and school clinical staff. 

PupiUcentered objectives of the program focus^ on gains in reading 
U, t^^nsh and Spanish. matlvenaticS. oral English-language competence, and 
cultural heritage.. Other program objectives included involving parents in 
the progr^ and improving th. instructional s.iUs of classroom teachers. 

The proqr*, was comprised of four principal components: resource 
servi.es; direct pupfl instruUion; staff development; and parent involve- 
ment. The following sections present the findings of interviews con^utted 
It n1.. project sites. Staff intfrviewed were thirteen mirm^\ mtW 



edocatibh teachers and two edueatibrial assistants, as well as the Esperanza 
project coordinator and two resource specialists. 

FINBTNRS 

Level of Implementation 

During the 1982-83 aead^ic year, l^roject Esperanza served 515 students, 
an increase of 11 percent over the previous year's cycle. Participating 
students attended 44 bilingual special edoeation classes in 28 schools 
located in Manhattan, the Bronx, Brooklyn, m Queens. In addition to the 
elementa.^, intennediate, and junior high schools for which the program 
was designed, progran, sites were also located in two high schools and one 
Occupatibhal training Center. 

All of the project staff were fundel under a Title VII grant; most 
were hired during the first program cycle. The project coordinator 
supervised and coordinated the organization and implementation bf the 
program, and was responsible for fiscal management, as well. A curriculum 
specialist developed curriculum materials and instructional objectives for 
students and a training program for parents, and demonstrated the program- ^ 
developed curriculum to the resource specialists. Two resource specialists 
assisted the classroom teachers in student assessment, instructional 
planning, ar.d identifying and using instructional materials; in addition, 
they offered classroom demonstrations and conducted workshops for partici- 
pating teachers and educational assistants. Two bilingual family assistants 
served as liaisons between the school and the students' homes and assisted 
at the parent workshops, and two itinerant educational assistants aided 
teachers in preparatidh of materials and in individual and small group 
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instruction; 

Finally, reqional-levsl , tax-levy bilinqual special education staff 
assisted in the coordination of Esperanza tasks in each of the regions, 
particularly parent and staff training. 

cvices 



Consultatioft . The resource specialists, who trained and assisted the 
classroom teachers and educational assistants* played an important role in 
providing on-site support. During regular visits to the classrooms, th^ 
provided direct, on-the-spot consultation to bilingual special education 
teachers concerning program-developed and commercial materials, learning 
problems of individual students as observed in the classroom or as reflected 
by the tests, and development and impl ariehtation of each student's individ- 
ualized education program (I.E. P.). In addition, they offered advice on 
classroom management and organization. 

With only one exception, all of the teachers expressed appreciation 
for the competerit. task-oriented consultations provided by the resource 
specialists; they were extranely interested in seeing the consultations 
continue. Many teachers described the program staff as "supportive" and 
"accessible"; 

curriculum Guide . 0ne of the goals of the three year Project Esperanza 
program was to develop a curriculum guide to be used by teachers in the 
instruction of their bilingual special education students. The distribution 
ef the guide was to take place in the spring of the third year of the 
project. The final version of the guide was jsresented to all teachers 
working in the project during April of 1983. However, teachers had been 
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introduced to the Esperanza cuFrlculuS bh ah ongoing Basis throdghodt the 
three years, either daring workshops or Indivlddally by the resource 
specialists. Thus, they had been worRrng with drafts of the guide for the 
duration of the project* 

i5%3Chers were asked to comment on the value of m curriculum guide. 
Eleven of the 13 teachers praised the guide for its innovative lessons 
which integrated a number of learning areas in each lesson. Over half of 
the teachers reported that students had benefited from the math curriculum 
and the corresponding tests. A n«jority also singled out the development 
Of cultural identify as an important aspect of the program and felt that 
it helped promote a more positive self-image in students. 

The major suggestion for improvement of the guide was for expansion of 
materials provided for each lesson. Although an abundance of materials 
were provided, because of the heterogenity in students' background and 
srills, sonjs teachers felt the guide should fepreseht a larger variety of 
Hispanic cultures across a wider range of educational levels. 

Direct tftstrqctibnJina Student Assessme nts 

Educational assistants, whose time was shared by a number of classrooms 
in their assighid schools, helped to provide individual and snail group 
instruction under a teacher's direction. The focus of iflstruction was on 
the individual student's learning needs. Including the development of 3 
positive cultural identity. Classroom teachers reported that they initiany 
eommuhicated with students in Spanish, their dominant language, while 
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helpinq them to expand their vocabulary and to develop liriguistlc and 
other academic sfcills in English. 

According to teachers, the assessment devices were an effective means 
of diagnosing problems and providing individual learning objectives. The 
math ,m reading t^sts. in combination witfi the curriculum, were seen by 
teachers as particularly positive aspects- of the program. 

Staff Dev glopmeht 

Teh of the 14 bilingual special education teachers reported that they 
had been introduced to the Esperanza program during an orientation session 
at which a number of other bilingual prograr^s were also introduced. Only 
four teachers reported not having received an orientation session. In 
addition to the orientation sessions, teacher-training workshops were 
offered about once every three months, usually consisting of a lecture, a 
discussion, and hands-on experience. Information provided at these 
workshops included: the administration of Esperanza-related tests-, the 
use of test results to diagnose the problems of individual students and to 
establish learning objectives for the«. as well as how to follow through 
in classroom instruction; discussion of the activities presented in the 
.,«.ran'J '■mtural heritage curriculum, including the development of 
activities to teach a particular thefle. and methods of combining learning 
Objectives within one activity; discussion Of discipline and classroom 
„«nagement; and discussion of how to improve parent involvement and 
parent-teacher eomniinication in the progrim. 

All twelve of the 13 special education teachers interviewed expressed 
strong satisfaction with the workshops and wished to see then continue; 
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however, one teacher felt that she was already farriiliar with the concepts 
presented at the workshops. In additien to the development of skills and 
materials for teaching bilingual special education students, teacfiers 
reported that the opportunities to exchange ideas and experiences was 
valuable and contributed to their sense of confidence. 

Pa rent Invblvement 

Parent involvement In the ptbqrm was prcttioted through a series of 
workshops, a Parent Advisory CdUhcil. and We activities of the bilingual 
family assistants. Workshops covered a variety of topics of interest to 
parents including: the law and parents' rights; the evaluation process 
and the role of S.B.S.T. and E.Q.H.; O.S.E. philosophy, programs, and 
services: the I.E.P.; activities for parents to do at home with their 
children. ■ ^^^..^^^ ^r.. Resource Gua4e. and thi Parent Cu..l^ _Guide; 
and information on public housing and social services. Staff Interviews 
indicated that efforts were made to secure parent participation; as in the 
nrpvious orocram cycles, all parents of program students were invited to 

t ' ^ 

attend the workshops through letters and phone calls, and baby-sitting 
and transportation were provided. Although there was improvement over the 
previous cycle, parent involvemer,t ms again less than hoped for. (See 
Chapter III.) m addition to the Esperanza staff, regional-level . tax-levy 
bilingual special education staff assisted in parent outreach in some 



regions^ 

Teachers 9.« a number of p6ss1bU reasons for thi lack of involveieot 
by parents, incladihg t«e Unsafe en,1ro-iSents of the schools and parents- 
lack 6f eO»cation. «h1cfi 1« to their feelln, intWiSated by the schools. 
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suggestions; offered to increase parent inwdlvemeht in the future 
included increasing the number of phone contacts and home visits prior to 
parent meetings at the school, and holding parent meetings ir, the scJ 
attended by their children. 
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III. EVALUATiON QF TRE ATTAINHENt OF PROGRAM OBdEeTIVES 

Project Esperanza was designed to attairi seven program objecUves. 
Five of these objectives concerned pupil achievement, one concerned parent 
participation, and one involved mastery of teaching skills In response to 
staff development. The foUowing sections present the objectives of the 
program, the methods of evaluation, and the findings, preceded by a 
description of the student population. Because of the individualized 
nature of the program, instruction varied according to the student's 
needs. Eonsequently . the numbers of students fbr whom achie»e^nent data 
were reported and analyzed differ somewhat among content areas. 

OescriptLon of the Populaiioft — 

Classroom teachers reported descriptive, attendance, and achievement 
data for 515 students on D.E.E. -designed data retrieval forms. Students 
ranged in age from seven to 21 years; the mean age was 13.0 (S^ » 3,(5). 
One-half (50 percent) of the students were in elementary schbdss^ 31 
percent v^re in intemerflate and junior high schools, afid 19 percent ^re 
in high schools and Occupational Training eenterSi 

Nearly thr^fourths {73 percent) of the students were classified as 
learning disabled and were served in Health Gonservation 30 classes (H.e* 
30). and 20 percent were in classes for educable mehtally retarded. The 
renaining students were neurdlogieany impairfid and emotionally Handicapped, 
or emotional ly handicapped. 

Nearly all (593 or 98 percent) of the students entered the program 
daring September. 1982; the other 12 pupils entered in November. The 
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nutSber of sessions attended ranged from a mihimum of four to a mx]mm of 
185. The mean number of sessions attended, at the rate of five sessions 
per week, was 123.4 (S^ - 33.8); the median was 140.3 the niean pereehtaqe 
attendatice was 75i3 percent (SJ^j. = 24.7). 

A breakdown of attendance by school level showed similar patterns of 
attendance for elementary students (H = 131.7, - 38.5), intenr^diate 
and junior high school students (M 115.3. = 31.8), and hiqih school 
stodehts (M = US. 7, S.&. = 43.8). 

OBJECTIVE 1. ^NGtlSR-REABING MASTERY 

An objective of Project Esperanza was to prijmote mastery of skills in 
English reading by thosi students who denonstrated the ability to profit 
from instruction in English as a second language. Specifically, the 
objective proposed that by June 15, 1983, 70 percent of the students 
receiving instruction in English would master four new reading objectives, 
as measured by the Prescriptive Reading Inventory {P.R.I.). The 
measures skills in the areas of readiness, phonology, structural analysis, 
and comprehension. Test administration was ongoing, each student 

was tested immediately after instruction in a specific skill* 

To determine whether the objective was attained, a frequency distri- 
bution of the number of skills mastered by students receiving Esiglisb- 
reading instruction «as prepared. According to these data, which are 
presented in Table 1, 200 or 93.3 percent of the 217 students receiving 
English instruction attained the four-skill criterion; the mean number of 
skills mastered was 6.1 (Mr = 2.6) and the mode was five skills. 
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table 1 



Frequency distribution of Mastery of Objectives 
in English Reading 



Number of 

Objectives Mastered 


Number of 


Relative 
Percent 


eumolatlve 
Percent 


m or more 


28 


13.4 


13.4 


9 


le 


4.6 


IR.n 


8 


13 


5.0 


24.0 


7 


12 


5.5 


- - - 

29 .5 


6 


47 


- - - 
21.7 


OimC 


5 


60 — 


7.7 


78.9 


4 


23 


13.4 


93i3 


3 


6 


2i8 


96.1 




4 


l.fi 


97.9 


1 


6 


2.fl 


99.7 








0 


1 


0.5 


100. 2^^ 


m 







^Measured by the Prescriptive Reading Inventory. 
''Exceeds 100 percent due to rounding. 

• Over 93 percent of the students mastered four or tnore English- 
reading Skills. Accordingly, the criterion of 70 percent was 
exceeded i 
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the objective for Englisfi rinm ™stei7 was sltsfhed. 

Analyse. 6t mitm by school le.ei iMicated soie vaMabiUt, in 
attainsent of the four-skHI criterion. Speclflcany. oot of 195 (95 
oercent) of the el^entary stad.hts, and 45 out of 46 (98 percent) of the 
hip sCHooi student, ™stered four af ^re «e« skiUs. but only 52 out of 
66 (78 percent) of the intemedUte and junior high school students did 
so. A further analysis of the typ« of objectives Sastar« indicated that 
readiniss accounted for 30.8 percent of the Objectives attained By all 
students, phonology accc.Sted for 28.8 percent, structural analysis for 
22.1 percent, and conprehension for 18i2 percent. 

There was a statistically significant feUtionship between the ™ster, 
of Engliih readinq skills and prograi sttendance (£ - .36; £ < .01). 
Attendance accounted for 10 percefit of th. shared variance at the elementary 
school level (r > .32. £ < .01). si. pefceht at the intermediate and 
junior high school level (r = .40. P < .01) and 23 percent at the high 
school Uvel (r > .48, £ < .01). Accordingly, gains iS English reading 
appealed to be positively related to program attendance. 

fiRjFrfivE 2. gpaai'iB peAOlNG mastery 

The program objective in Spanish reading stated that by dune 15, 1983, 
;0 percent of the participating sfaents receivifig instruction iS Spanish 
«ould ™ster fou? skills. The objective was «asured through ongoing 
ad»rinistrat1on of the Spanish Developmental Reading PrograS (LeaSds). 

Table 2 pFisents the freguiScy distribution of the number of Spanish- 
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table 2 

Frequency Distribution of Spahish-Readjng 
Skills Mastered by Program Students 



Number of 

Objectives Mastered 



Number of 
Students 



Relative 
Percent 



Cumulative 
Percent 



u 


53 


23.5 


23.5 


id 


12 


5*3 


28.8 


9 


11 


4.9 


33.7 


8 


9 


4.0 


61 ml 


7 


10 


4.4 


42.1 


6 


42 


18.6 


60.7 


5 


^9 


12.8 


73.5 


4 


18 


8.0 


81.5 


3 


12 


S.3 


86.8 


2 


17 


7.S 


94.3 


i 


8 


3i5 


97.8 


e 




2.2 


100.0 



'Measured by the Leamos Test of Spanish Reading. 



• ftore than 81 percent of the students mastered at least 

hew skills. Accordingly, the 70 percent criterion was exceeded. 
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reading sMlU mastered pr5gram sf^dehts. Masttrjr ranged from a min- 
imn of no objectives for five students to a niaximtjm of 11 objectives for 
53 students. The mean was 6.6 (Mr. ' 3^3) with a Tediaf» of 5.1 and a 
mode of 11 skiUs. More than 81 percent of the 226 students instracted in 
Spanish reading attained the four-sMIl criterion. Aecerdingly . trc 

objective. was surpassed. 

To determine whether the program had a differential effect upon 
student mastery of Spanish-readihg skflls by school level, the percentage 
of students attaining the four-skfll criterion wss determined for th,e 
elementary, middle, and high school populations. Results Indicated that 
121 of the 135 elementary students (89,6 percent) and 25 of the M high 
school students f73.5 percent) attainei the crlteH^n. but only 37 of the 
56 interjsediate and junior high school students (65.1 percent) did so. 
Nohetheless, the overall objective was attained. 

To measure the relationship between amount of instruction and Spanish- 
reading-skills mast«ry, a Pearson product -tnoTOht correlation coefficient 
was computed between the naSber of oSjectives mastered and the number of 
program sessions attended. Tne observed correlation was statistically 
significant (r « .44, £ < .01). Over 19 percent of the variafvce in nutntver 
of Spanish-reading objectives was accounted for *jy program attendance. 

This relationship ^it most pronounced at the High schoo] level where 
attendance accounted for 36 percent of the shared variance (r * .60. 
p < .91). slightly loser for the intermediate a«d junifor high school level 
I3I percent of t*.e variance., r - .56, g < .01), and lowest at the ele^ntanr 
school level (15 percent. £ = .39» £ < .01). 
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ftMPTTltfF L HASt ERY 4y^&mMiliS SKILLS 

The mat^iOTatles objective of Project Esperanza stated that By done 15* 
1983. 70 percent of m partteipatirtg students wbald demonstrste mastery 

four of the seuaed math objectives which they Kad not mastered by 
Septentoer. mz. me objective was m^asared 0"go1"9 administration 

of the Diagnos't^c M^thsj^Btlts Invantdry (D.M.I.). 

Table 3 pr€s^ots a fres^uency distribotion of the number of O.H.I * 
skills festered by the project stiidents i«istrt,ct€« in mathanatics. Data 
were reported for 450 students. Histery of mt^m^m skills Panpd frorf^ 
one sMIt for Students to 11 skills for *7 students. The mean was 5.6 
(S^. , j,tiU th« median m% *.9, and the mode was four. Over 73 percent 
Of the students attained the foar-skiH^crUerion, Accordingly* the 

objective ws achieved^ 

Analyses of the percentage of nudents at eacfi school level who 
attained tl^e four-skin criterion again indicated variability. The 
criterion was attaiMi by 80 percent of the elementary school students, or 
192 m of 2405 74 percer^t of the hlgl^ school students, or 61 out of 82; 
but onlf 61 percent of tlie middle school students, or 77 out of 127* 

Of the skills mastered tey all students. 32.5 percent were in basic 
computation operations of mmm. sybtraction. multiplication, and 
division of whole nuisbers. Meafure«ent and geometry accounted for 14.8 
percent of all ob|*ctives nastered; functional math, including concepts of 
mn^, tm. m tsnp^r^ture. for 13.8 percent; preoperational skills such 
as counting ^atc^ing. for 8.9 percent; and fractions for 6.7 percent. 
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Table 3 

Frequency Distribution of the Number of Mat|andt1cs 
Skins Mastered by Project Students 



Number of 

Objectives Mastered 



Number of 
Students 



Relative 
Percent 



Gumiilatiye 
Percent 



U 

10 
9 
8 
7 
$ 
5 
4 
3 
2 

i 

0 



47 

23 

27 

23 

24 

38 . 

72 

76 

68 

24 

22 



10.4 
5.1 
Bid 
5.1 
5.3 
8.4 
16.0 
16*9 
15.1 
5.3 
4^9 
1.3 



10.4 

15.5 

21.5 

26.6 

31.9 

40.3 

56.3 

73.2 

88.3 

93.6 

98.5 

99.8^ 



^Measured by the Diagnostic Matfiematic Inventoi^ 
^Less than 109 percent due to roonding error. 

i Over 73 percent of the students who received ^"f^f^c^lf^d^ 
mha«at1cs attained the four-skill critiri^n; the proposed 
valo« of 70 percent was surpassed. 



-18- 



The remaining objectives were distributed among a number of assessment 
areas including number theory and place value* 

Tfiere was a statistically significant relatiofiship between the mastery 
of math skills and program attendance for all participants (£ = .45, P < 
.01). For the junior high and high school groups, this relationship was 
particularly strong as indicated by Pearson product-moment correlation 
eaefficients of .61 and .64 (£ < .01). respectively, between number of 
skills mastered and number of sessions attafided. Attendance accounted for 
37 and 41 percent of the variance in math mastery and thus, gains in 
mathematics skills appeared to be related to program attendance for these 



groups. 



An objective of Project Esperanza proposed that participating students 
would demonstrate statistically significant growth (£ < .05) in oral 
English. The objective w^s measured by comparisons of English-language 
samples taken ciuring the fall and spring semesters. The samples consisted 
of the students' oral-English productions in response to the presentation 
of pictures that related to the program's curriculum. Stimuli were 
presented Individually until ten sentences were produced. The average 
sentence length of these productions was scored in T units according to a 
technique adapted from the Basic Inventory of Natural hanguage (B.I.N.t.). 
The pre- and post-test scores were compared through a t test for correlated 
samples: scores were reported for 466 students. The average pre-test 
score was 4.8 I units (Mr = 2.7) and the average post-test score was 6.1 
T .nits (S^ = 3.4). The mean gain of 1.3 T units was statistically 
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significant [t = 8.34. df = 465. p < .01). Accordln^l^r. the objeetive was 
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To deten^ine whether the gains in English-language scores differed 
significantly among students grouped by school level, a one-way analysis 
of covariance was applied to the poSt-test n«ans by school level, controlling 
for differences in pre-test .eans. (See Table 4.) In contrast to previous 
cycles, no significant differences were found between school level in 
mastery of objectives in oral-English. 

HR^FFTTVF 5. MASTERj^ EybTllRAL HERITAGE^mRI£UI-UW 

The fifth pupil Objective stated that by June 15. 1983. 70 percent of 
the participating students would demonstrate mastery of four objeetivet of 
the cultural heritage curriculum. This objective was measured by a 
locally-developed cultural heritage assessment instrument. This crlterlon- 
referehced instrument was designed to measure mastery of specific skills 
in six cultural heritage areas: language arts. math, science, social 
studies, art. and music. Teachers also had the option of adding another 
category. Students were tested o. two itens for each area and thus. c*ld 
.aster up to 14 objectives. Three levels of the instrument v«re constructed: 
al^ihtary. intennediate. and advanced, eontint validity of the instrument 
was demonstrated by judgements of D.S.E. staff and program personnel that 
the items on the instrument thoroughly represented the content of the 
program's cultural heritage curriculum. Test administration occurred in 
May, 1983; scores were reported for 423 students, 

fable 5 presents the frequency distribution of the nuiber of cultural 
hentage objectives mastered by the target population. Mastery ranged 
front a Minimum of one skill, by three students, to a maximum of 14 skills 
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Table 4 

Analysis of Coyarlance for.P°5^'"^®*^ 
English-Language Scores 
by Sehodl Level 




Source of Variation 



Covariates 

p re-test Language Score 



6807 



School Level 
Residual 



2 

461 
464 



242 



< .01 

n.s. « not significant 

. After controlling for the effects of pre-te$t^5C0 
signiflcSm difflrences were found antong the thre 
levels. 
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Table S 

Frequency Distribution of the Number of Cultural 
Heritage fibjectives f^s|ered by 
Program Students 



Number of 
ills I^stered 


Students 


Relative 
Percent 


Cumal^^He 
Percent 


1 A 


44 


10/.4 


10.4 


13 




3i3 


13.7 


12 


65 


15.4 




ii 




9.5 


38.6 


io 




9.9 


48,S 






4.3 




8 


3b 


7*1 


59.9 


7 


47 


U.l 


71*0 


6 


51 


12.1 




5 


38 


9.n 


92.1 


4 


15 


3.S 


95.6 


3 


11 


2.fi 


98. a 


Z 


5 


1.2 


99,4 


1 




.7 


1(50,1^ 


TO 







^Measured by locally-developed cultural heritage assessment instrument* 
''Exceeds 199 percent due to rounding error* 

■ More than 95 percent of the students tested mastered at least 
four skills; the criterion of 70 percent was surpassed* 
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by 44 studihts. Students at all prograti levels surpassed the dbaective of 
.mastering four or more cuUural henta^ objectivts; 96.6 percent of the 
eleneotar^ school Students did so. 94.4 percent of the intennediate scHadl 
students, and 92.3 percent of the high school students. 

Further analyses of these data indicated that most of the cultural 
heritage instruction «as in academic areas. Nearly 97 percent of 
students for «hor, cultural heritage data were reported mastered at least 
one language arts skill. 95 percent mastered at least one mtn skill. 93 
percent mastered science skills, and 82 percent mastered social studies 
stills. Art and n«s1e skills «ere mastered by 73 percent and 50 percent, 
respectively. 

The <listributidn of cultural heritase instruction followed a similar 
pattern for elementary and intennediate and junior high school st.Kients. 
For high school students, on the other hand, the distinction between 
academic and non-acadenic objectives was more pronounced; only half the 
uodents mastered art objectives and fev^er than one-fifth mastered music 
olsje«t»eSi (See Table 6;) 

^^^TTT"'" ' iKVOLVEHENT 

The program objective tor firm. it>,ol.eSent «s tMt « Wne. 
58 percefit of tfie parens of partUipStinJ students tm part In two 

,ct1.1t<es for parefits. In order to detenilne Whether the object<« -as 
^t. program records of piPent participation in progra™ sponsored activities 
«re examined. Secbrds «re a,aila61.s for 12 parent «rtSh«ps and one 
pafent Advisor? Council nietihg. These fecofd, showed that average parent 
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Table 6 

Number and Percentage of Students 
At Each School tevel.fino. _ 
Mastered Cultural Heritage Skills iri Each Area 




Area 



Elementary 
N - 236 



nguage Arts 


231 (97.9) 


th 


228 (96.6) 


lence 


225 (95*3) 


cial Studies 


207 (87.7) 


t 


185 (78.4) 


sic 


165 (69.9) 



Intermediate/ 

ior 

N = 122 



118 (96.7) 
118 (96.7) 
112 (91.^) 
101 (82.8) 
91 (74.6) 
74 (60.7) 



High School 
N ^ U 



60 (93.8) 

56 (87.5) 

57 (89.1) 
38 (59i4) 
32 (50.9) 

9 (14.1) 



• For all groups the (nost frequently taught cultural heritage 

b ectiv s w^re in academic areas; about 90 percent or more 
of the students in each group mastered skills in language arts, 
math, or science. 

• Skills in art and nw sic i^ere -Mastered by j ^jority of e»ntary. 
intermediate and junior high school students and by 50 percent or 
less of the high school students. 



Total 
N ^ 423 



410 (96.9) 
403 (95.3) 
395 (93.4) 
346 (81.8) 
308 (72.8) 
248 (58.6) 
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attendarics was about 10. In all. 123 parents of participating students 
attended at least one activity, representing 24 percent of the target 
students. Of these, only four parents attended more than one activity * 
well short Of the criterion of 50 percent. Accordingly , the objective «as 
not attaihedi 

Although the criterion was not achieved, it must be noted that parent 
participation itnproved substantially over the previous cycle when only 
about eight percent of the parents of program students attended at least 
one prograni-sponsored or -prOToted activity. 

OBJECTIVE 7. STAEF DEVELOPMENT 

As part Of its staff developtnent component, Esperanza personnel 
conducted workshops for both program staff and tax-levy classroom teachers 
to develop their skills in special and bilingual education. The specific 
objective of th*s component was that by dune, 1983, 80 percent of the 
participants would demonstrate mastery of one teaching skill per training 
session. The program provided three teacher-training workshops in 1982- 
83. Heah attendance was 29 staff. For each wdrksh<5p, about three-fourths 
of those attending were participants and the rest were administrators, 
guests froin other bilingual prbgrMS, or presenters. 

In order to measure their master^ of teaching skills in response to 
the training, participants were asked to prepare individualized lessons 
Iheerporating information from the presentation; lessons included instruct, 
ional objectives and materials. Participants worked together In small 
groups, wrote up the lessons, and then presented their ideas to the whole 
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group. All participants submit;dd written materials de^dhstfatihg mastery 
of the workshop presentation. Accordingly, the ohrjective criterion of m 

percent was surpassedi 

Participants in the three teacher-training workshops were also asked 
to fill out questionnaires concerning the workshops. These questionnaires, 
each of which had 12 items, assessed the quality and presentation of 
workshop objectives, activities, materials, and leader effectiveness. 
Responses indicated that the large majority of participants were quite 
Pleased with the teacher-training workshops. With only two or three 
exceptions, all of the participants selected the highest or next-to- 
highest ratings for at least 11 of the 12 items. Most "average" or "poor- 
ratings were in response to an itan whteh asked about length of ti.Se for 
partictparTt qoestiohSi 
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IV. CdNCLUSIONS ARB REGOHHENDATIONS 

The analyses of data fran pupil achievement measures and pmrm 
interviews and observations lead to the overall conclusion that Project 
Esperanza. in its final year of operation, continued to provide an effective^ 
cDnprehehsive prograr. of suppl euentary services that has pranoted the 
academic development of hanaicapped L.E.P. students. In its third year, 
the program served 515 students in 44 bilingual special education classes 
in 28 schools- 

As in previous cycles, all of the program objectives for pupil achievement 
were attafned; the proposed criteria were met in English and Spanish 
reading. oral-English prof icien..y . mathenatics. and cultural heritage. 
The project objective for teacher training was also attained. In response 
to pdrticipation in teacher workshops, the classrow. teachers danonstrated 
proficiency in developing lessons integrating cultural themes with academic 
skills. Despite repeated efforts by project staff and improved participation 
over previous cycles, the objective for parent involvement was again not 
attained. 

interviews and responses to questionnaires revealed that the program 
was highly successful in providing effective and valuable staff training. 
Teachers received individual consultations as well as workshop training in 
materials, methods for individualized assessment and instruction, and the 
use of an innovative* cul tural ly-relevaht curriculum. 

The following recommendations are offered for the further enhancement 
of student gains and staff effectiveness: 
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continue to reeruit and place qualified bilingual special 
education teachers; 

continue to identify, adapt, dr.create appropriate curri- 
culum Mterials and evaluation instruments; 

continue to identify, develop, and standardize new tests 
and procedures for measuring language fjelop.-nt for 
special education students with limited English 
proficiency; and 

continue efforts to involve parents in instructional work- 
shops and other school-related activities. 
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